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t.  Introduction.  Inference  problems  in  variance  components  models  have  been 
investigated  extensively  in  the  literature.  These  include  estimation  of  fixed 
effects  and  variance  components  (the  latter  mostly  by  the  MINQUE  method  and 
its  modifications)  as  well  as  tests  of  hypotheses  for  both  fixed  effects  and 
variance  components  in  general  mixed  ANOVA  models.  For  such  models  with 
balanced  data,  it  is  known  that  the  usual  tests  for  fixed  effects  are  optimal 
(UMPU,  UMPI)  [vide  Seifert  (1978,  1979)].  However,  for  tests  on  variance 
components,  optimal  tests  are  known  only  for  special  models  like  the  one  way 
classificaiton  model  and  two  way  classification  model  with  or  without 
interaction  (vide  Herbach  (1959),  Spj^tvoll  (1967),  Das  and  Sinha  (1986)].  Some 
exact  tests  are  obtained  in  Seifert  (1981,  1985).  It  may  be  mentioned  that  the 
recent  book  by  Arnold  (1981)  while  dealing  with  tests  of  variance  components 
mentions  no  optimum  tests  but  only  some  valid  exact  tests. 

In  this  paper  a  general  balanced  ANOVA  model  with  mixed  effects  is 
considered  and  UMPU  and  UMPI  tests  are  obtained  for  hypotheses  on  fixed 
effects  as  well  as  variance  components.  The  tests  are  derived  under  the 
usual  assumption  of  normality  of  the  random  effects  and  it  is  shown  that  the 
tests  coincide  with  the  standard  F-tests.  Null,  nonnull  and  optimality 
robustness  of  the  UMPI  test  [vide  Kariya  and  Sinha  (1985)]  against  suitable 
deviations  from  normality  of  random  effects  is  established.  It  may  be 
mentioned  that  for  unbalanced  mixed  effects  models,  even  though  exact  tests 
are  available  in  some  cases  [vide  Thompson  (1955a,  1955b),  Thomsen  (1975), 
Pincus  (1977)  and  Seely  and  El-Bassiouni  (1983)],  the  problem  of  deriving 
optimum  tests  for  variance  components  in  general  is  still  open  (see,  however, 
Das  and  Sinha  (1986)  and  Spj^tvoll  (1967)  for  the  one  way  unbalanced  random 
effects  model).  This  is  currently  under  investigation  and  will  be  reported 
elsewhere. 

2.  Mixed  Models  with  Balanced  Data  and  a  Canonical  Form. 

The  model  under  consideration  is 

(2.1)  Y  =  X  a  +...+  X.  «.  +  Z  u  +...+Z  u  . 

«  t  k  k  ii  c  c 

Here  Y  is  the  n-dimensional  vector  of  observations,  X^  =  1^  (the  n  component 


■W  "  J 
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vector  of  ones),  «  =  n,  the  general  effect,  a^’s  are  the  vectors  of  fixed 

effects  (i  =  2,...k),  u.’s  are  the  vectors  of  random  effects  (j  =  l,2,...c-l) 

J 

due  to  the  various  factors  (crossed  or  nested)  and  their  interactions.  We 

assume  that  Z  =  I  ,  the  identity  matrix  of  order  n,  and  u  is  the  vector  of 

experimental  errors.  The  u^’s  are  assumed  to  be  independent  random 

variables  distributed  as  normal  with  means  0  and  covariance  matrices 

»2.I  (j  =  l,2,...c)  (<r*  *  0  for  j  =  l,2,...c-l  and  <r3  ^  0).  Thus  E(Y)  = 

Jkn  J  c 

.  E  ^iai  =  w^ere  *  =  (Xj!---:  )  and  «  =  (“*»<** . and  D(Y)  = 

V  =  I  oa.V where  V.  =  Z.Z*.  (j  =  1,2,  ...,c)  and  V  =  I  .  Each  X.  (and  each 
j=i  J  J  J  J  J  c  n  i 

Z.)  is  a  kronecker  product  of  identity  matrices  and  the  vectors  1  of 
3 

appropriate  orders.  Hence  V  .  is  a  kronecker  product  of  I  and  J  matrices, 

•  ^ 

where  J  =  11  .  For  a  detailed  description  of  models  with  balanced  data,  we 
refer  to  Seifert  (1979)  or  Anderson  et.  al.  (1984). 


^>1 


Let  (i  =  l,2,...,k)  and  ^  (j  =  1,2,.. .,c  -  1)  be  projectors  where 

Pt  =  ~  J„  such  that  Y’PjY  and  Y’QjY  are  the  sum  of  squares  due  to  and  uj 

(as  in  the  fixed  effects  models)  respectively.  Clearly  Pj’s  and  Qj’s  satisfy 

PjP|  =  0  (i  *  4),  QjQ<  =  0  (j  *  <)  and  PjQj  =  0  for  all  i  and  j.  The  error 

sum  of  squares  is  y’(I„  -  E  Pj  -  't'qOY  =  Y*QCY  (say).  We  note  that  each 

i=»  j=»  J  i 

Pj  (and  each  Qj)  is  a  kronecker  product  of  matrices  of  the  form  Ia,  g  Jb  and 

Id  ~  j  **d  (this  follows  from  the  rules  for  writing  down  the  sum  of  squares 

for  balanced  data  given  in  Searle  (1971,  pp. 389-404);  see  also  Seifert  (1979), 

Section  2).  Consequently,  for  each  i  and  j,  V.P.  (  and  V.Q.)  is  either  zero 

^  J  c  i  J 

or  a  multiple  of  P.  (respectively  Q.).  Since  V  =  E  »?V.,  we  get  VP.  =  P  .P  . 

J  J  i=i  i  i  J  J  J 

and  VQ  .  =<5.Q.  ,  where  P.  and  6.  are  positive  linear  combinations  of  <t?’b. 


Hence 


(2.2) 


Consequently 


(2.3) 


It  o  K  c 

v  =  Evp.+  E  vq.  =  ip. p.  +  E  <5  .q . . 
j=i  j  j=i  j  j=i  j  j  j=i  j  j 


K  c 

=  E  •  .P  •  +  E  r  Q .,  where  ».  =  1/P .  and  r.  =  1/6.. 
j=i  J  J  j=i  J  J  J  J  J  J 


If  P  =  ,1  P„  then  XP  =  PY  is  the  BLUE  of  Xp.  If  rank  (P.)  =  p.  and  rank 
j=»J  i-i I  kp.cq  J  J 

(Q.)  =  q.,  then  |v  |  =  (  .fi  ®;J)(.n  r:J)- 

J 


Using  the  above  expressions  for  V 
Xp) 


(Y  -  X/?)’V  ‘(Y 


and  |V|,  and  using  the  relation 

Xp)  = 


(Y  -  PY)’v“‘(Y  -  PY)  +  (PY  -  XP)’v  1 (PY 


y’qV  *QY  +  (PY  -  X0)’V  ‘(PY  -  XP)  (where  I  -  P  =  Q  =  £  Q.),  the  density  of 

i=t  1 


Y  can  be  written  as 


-n/a  k  p  .  /  C  q  .  ,  l  r  c  , 

(2.4)  f (y)  =  (2 tt)  n/  (  n  «  J/a)(  n  T.J/*)  exp(-  5  £  t  .y’Q  y 

j=i  J  j=i  J  ^  l.j=i  J  J 


+  iI,*i<si>r  -  -  vl1 


where  we  write  P.  =  S.  s/fs’.S  .  =  ID  )  and  7.  =  s’.Xp.  The  parameter  space  is 


1111 


0  =  {T.*,7 :r  *  0,  Vj; 
.  J 


P-1  X 

•  ^  0,  vi;  7^  e  R  x,  vi).  Clearly  S^Y  (i  =  1,2, ...,k) 


and  Y  Q.Y  (j  =  l,2,...,c)  jointly  form  a  complete  sufficient  statistic. 

J  1*1 

the  definition  of  and  it  follows  that  ^-7~E(y’q^Y)  =  77-  and 

d7~  K[(S’Y  -  7.)’(s!y  -  7)]  =  *  The  terms  t.y’q.Y  and  ».(s!y  -  7.)’ 

1111  1  J  J  111 


From 


p  «U“;  ■  I  ■  J  v "  4  *  /  •  )  J  -  O 

y  J ,  1  11  1  j 

(S.Y  -  7)  are  independent  and  have  central  chisquared  distributions  with 


degrees  of  freedom  q-  and  p.  respectively  (see  Searle  (1971),  p.  409). 

J  l 


The 


hypothesis  of  interest  on  the  fixed  effects  is  H  '.7. 

7  1 

exact  test  can  be  obtained  if  ».  coincides  with  one  of  the  r.’s. 

YPiY/Pi  ° 


0  for  any  given  i.  An 
Thus,  if 


then  under  H 


r'  Yfl  Y/q 


has  central  F-distribution.  For  many 


balanced  models,  testing  <r?= 0  is  equivalent  to  testing  if  two  r.’s  are  equal. 

J 


For  testing  H  :r.  =  r.,  an  F-test  can  be  obtained  similar  to  the  test  for  H 
T  1  J  7 


described  above. 


Remark.  It  is  not  always  true  that  will  coincide  with  one  of  the  rj’s.  It  is 
also  not  true  that  <r2^  =  0  is  always  equivalent  to  the  equality  of  two  tj's.  A 
counter-example  for  the  latter  is  a  balanced  model  involving  3  factors  A,  B,  C 
and  the  two  factor  interactions  AB  and  AC,  where  C  is  nested  within  B  and  all 
the  effects  are  assumed  to  be  random.  The  expected  values  of  the  various 
sum  of  squares  are  given  in  Table  9.4  in  Searle  (1971),  p.  394  (also  given  on 
p.  411).  It  can  be  verified  that  <r2  0  (in  Searle’s  notation)  is  not  equivalent 

to  the  equality  of  two  t;’h  in  our  notation. 


-  5  - 


3 


3.  Optimal  Tests  and  Their  Robustness. 


Writing  v.  =  y’q.Y  (j  =  1,2, ...,c)  and  w.  =  s!y  (i  =  1,2,... ,1c) ,  it 
J  J  lx 

follows  from  (2.4)  that  the  joint  density  of  v  ,...,v  ,  w  ,  ...,w,  is  given 

l  Cl  K 


by 

(3.1) 


c  2  1  1C  If 

)  c(t,o)  n  v  exp(-  ~[  l  TV.  +  l  «,(w.  -  7.)’(w  -  7,)]). 

j=i  J  ^  j=i  J  J  1=1  lx  i  i  i 

a)  To  test  H  :y,  =  0  vs  H  :y.  *  0.  Assume  ®,  =  t  ,  so  that  an  exact 
7  k  i  k  k  i 

test  is  the  F-test  based  on  w,  w,  /v  .  If  y,  is  a  scalar,  then  it 

k  k  i  k 

follows  from  standard  results  of  multiparameter  exponential  family 
that  this  test  is  UMPU  (see  Lehmann  (1959),  Chapter  4).  However,  if 
the  dimension  of  7k  is  more  than  one,  then  a  UMPU  test  does  not 
exist.  In  this  case  a  UMPI  test  (which  coincides  with  the  above 
F-test)  can  be  derived  easily.  For  this,  we  note  that  the  above 
testing  problem  is  invariant  under  the  group  of  transformations 
(v,,...v,w  ,...,wk)  ->  «(v|,...,vc,wi  +  P,,...,wk  i  +  Pyr]}> 

where  a  ±  0,  /j^’s  are  arbitrary  vectors  and  P  is  an  orthogonal 


matrix.  A  maximal  invariant  with  respect  to  the  above  group  is 
w,  w,  v  v 

given  by  (— — ,  )  =  (Tj  ,Ta , . . .  Tc)  =  T*  (say).  The  null 

iii 

distribution  of  T  can  be  computed  as 


(3.2)  Constant  x  II  f.*/ah(T) 

i=3  1 


I1  +  *2  1+T 


■c  1+T 


"2tpk  +  i?,qi]’ 


where  (  .  =  7^  and  h(T)  is  a  function  of  T.  Thus,  under  H0, 

1  t 

Z  =  (Ta/1  +  T,,...,TC/1  +  T,)  is  sufficient  for  the  nuisance  parameters 
(f  2,...,fc)  and  it  can  be  shown  that  the  distribution  of  Z  is  complete. 
On  the  other  hand,  the  nonnull  distribution  of  T  is  given  by 

f 

_  £  .Hi  /,.  S  Ark/ .  _  ,r 


(3.3)  n  (  .  i/ah(T)  l  (-~)  d  CT./l  +  T,)r 

i  =  a  1  r=o  1  r 


+  (2  1+T,  +  ‘ • ’  +  (c  1+T, 


pk  +  khqi]  ~  r> 


'MM 

"-ivc 

*«  «*“„  **„  V  i  V  ‘ 

\  «  n 

iT.wrr 
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tK' 


where  dr  ^  0  are  constants.  Given  Z,  this  is  monotone  in  T,/l  +  T,, 
Since  the  null  distribution  of  T,/l  +  T,  is  independent  of  any 
parameters,  it  follows  from  Basu’s  theorem  (Lehmann  (1959),  page 
162)  that  T,/l  +  T,  and  Z  are  distributed  independently,  under  H0. 
Consequently,  the  test  based  on  T,/l+  Tu  i.e., 
the  F-test  based  on  T,,  is  UMPI. 


b.  To  test  Ht:  rt  -  ra  vs  H, :  r7  ±  T,.  in  this  case  the  F-teBt  based  on 

v2/v,  is  clearly  UMPU.  To  show  that  the  same  test  is  also  UMPI,  we 

note  that  the  above  testing  problem  is  invariant  under  the  group  of 

transformations  (v  ,...,v  ,w  ,  ...,w,  )  -*  (av  ,...,ov  ,  S~o i  (w  +  /i  ) , 
i _  1  ci  k  i  c  ii 

■■■■/"  <wk  *  ,,k)  ),  where  «  0  and  p.’s  are  arbitrary  vectors.  A 

v  v 

maximal  invariant  is  ( —  —  )  =  T*  (say).  From  (3.1),  the 


1  1 

density  of  T*  is  obtained  as 


(3.4)  f(T*U)  =  c(()[l  +  (T  +...+(  T  ]  q/2h(T*) 


2  2 


C  C 


where  q  =  Z  q.  and  {.  =  r ,/r  ,  j  =  2,...,c.  Under  the  null 

j=t  J  J  J  1 

T  T 

hypothesis  H  :  f  =1,  ( ,  irT,  , . . . , ,  m  )  is  sufficient  for  the 


ll+T2  ’•”,i+t2 


nuisance  parameters  (f  )  and  it  can  be  shown  that  its  null 

a  c 


distribution  is  complete.  Arguing  as  before,  it  can  be  seen  that 


the  test  based  on  v  /v  is  UMPI. 

a  i 


We  shall  now  discuss  briefly  the  robustness  of  the  above  tests  when  Y 
has  an  elliptically  symmetric  distribution.  Thus  the  density  of  Y  is 


(3.4)  f  (y)  =  I  V  j  \[(y  -  x?)’v  *  (y  -  XP)j 


where  ♦  is  a  nonnegative  function  on  (0,*)  satisfying  ♦(u’u)du  =  1. 

JRn 

Write  Q  =  and  W*  =  S*’y  where  S*’s*  =  Ia-,  j  =  1 . c.  Making  the 

^  vj  J  J  }  J  J  j  j  j  }  t 

orthogonal  transformation:  Y  -*  W  =  (W  ,  ...,W,  ,W*  , ...,W*  )  ,  it  follows  that 

1  A  1  ^ 

the  density  of  W  is 


(3.5)  f(w)  =  (  .fi  ^j/2)(.n  rqj/J)*[  l  r.w*’w*  +  Z  ».(w.  -  7.)’(w.  -  7.)] 
j-j  J  j=i  J  j=i  J  J  j  i  =  i  ii  i  l  l 


Since  ♦  is  arbitrary,  it  is  clear  that  the  standard  argument  of  multiparameter 
exponential  family  to  claim  UMPU  properties  of  the  appropriate  F-tests  for 
the  hypotheses  Hy’.jfc  =  0  and  Ht:t,  =  t2  breaks  down.  However,  the 
principal  of  invariance  still  applies  and  the  following  results  hold. 


(a)’  For  testing  H^lyk  =  ®  versus  H,:rk  *  0,  assuming  «k  =  Ti>  the 
F-test  based  on  ^wk/w*  w*,  which  is  the  same  as  iftwk/v,,  is 
UMPI  whenever  ♦  is  convex.  This  test  is  also  null  robust.  This 
follows  essentially  from  Kariya  (1981). 


(b)’ 


For  testing  Ht**ti  =  t2  versus  Hi:t2  ^  rlt  as  already  observed,  the 
problem  is  invariant  under  the  group  G  of  transformations 
(g:g  =  (<*,  a  *  0,  pj’8  are  arbitrary  vectors)  acting  on  w 

as  g(w)  =  a((  w,  +  p, )’,... ,(wk  +  /*k)'iwil|-twcV.  Then  dp,,...,d/ik 
d  a/a  is  a  left  invariant  measure  on  G,  then  applying  the 
representation  theorem  due  to  Wijsman  (1967),  the  ratio  of  the 
nonnull  to  null  distributions  of  T  is  given  by 

|  f(g(w)|Hj)J  'dpt . .  .d^d«/n 


(3.6)  R  = 


|  f(g(w)|HT)J  1cU»i .  .  .d^kd«/o 


where  J  is  the  jacobian  of  the  transformation  w  -*  g(w).  Using 
(3.5)  and  the  result  of  Dawid  (1977),  the  numerator  of  R  simplifies 
to 

h  Pi 

H,li  T  \  Jf  * )  |„  J  . 

R 


(3.7)  (.ft  oP^2)(.U  ^j/2)  H  Ip  I  Pu*[“J  *  TiwJj,w1 
j=i  J  .1=1  J  JO  ,'dk»  .j  =  1  J  J  J 


2  k 


+  a  J.  «.(w.  +p.  -  y .)  (w.  +/i.  -  7  •  ) )  * «  "dp 
111X1  l  l  i 

=  (  [1  ♦[0[J  I  T  .w*’w*]c«n  S  'da 

i=i  J  ,j=l  J  J  J 


.  d^da/a 


=  ( 


n  qi/2w  r  *»  *.-(n-s)/2  .  f  ~  2  n-s-1  ,  . 

.n  TiJ/  )(,L  T  ;W  ;  WT)  •{  ♦(<*  )  a  da) 

1=1.)  .1=  I  J  J  J  J  ° 


=  f  n  ...  f  n  *(x  +  u’u  + .  .  .  +  u.’  u.  )  du  .  .  .  du,  and  s  =  Ip. 
JRP>  JDpk  »  1  *  k  i  k  j=i  J 


j/3 


where  ♦Cx) 


Since  the  denominator  of  R  corresponds  to  the  expression  in  (3.7)  under  HTr 
follows  that  the  ratio  R  is  independent  of  ♦  .  This  means  that  the  normal 
theory  result  obtains.  Consequently,  we  have  established  the  null,  nonnull 
and  optimality  robustness  of  the  F-test  based  on  Vj/v,.  See  Kariya  and  Sinha 
(1985)  for  detail. 


REFERENCES 


Anderson,  R.  D.,  Henderson,  H.  V.,  Pukelsheim,  F.,  and  Searle,  S.  R. 
(1984).  Best  estimation  of  variance  components  from  balanced  data  with 
arbitrary  kurtosis.  Statistics,  15,  163-176. 

Arnold,  S.  (1981).  The  Theory  of  Linear  Models  and  Multivariate  Analysis. 
John  Wiley,  New  York. 

Das,  R.  and  Sinha,  B.  K.  (1986).  Robust  optimum  invariant  tests  in 
one-way  unbalanced  and  two-way  balanced  models.  Technical  Report, 
University  of  Maryland  Baltimore  County,  and  Center  for  Multivariate 
Analysis,  University  of  Pittsburgh. 

Dawid,  A.  P.  (1977).  Spherical  matrix  distributions  and  a  multivariate 
model.  J.  Royal  Statist.  Soc.  B,  39,  254-261. 

Herbach,  L.  H.  (1959).  Properties  of  type  II  analysis  of  variance  tests. 
Ann.  Math.  Statist.  30,  939-959. 

Kariya,  T.  (1981).  Robustness  of  multivariate  tests.  Ann.  Statist.,  9, 

1267-1275. 

Kariya,  T.  and  Sinha,  B.  K.  (1985).  Nonnull  and  optimality  robustness  of 
some  tests.  Ann.  Statist.  3,  1182-1197. 

Lehmann,  E.  L.  (1959).  Testing  statistical  Hypotheses.  John  Wiley  and 
Sons,  New  York. 

Pincus,  R.  (1977).  On  tests  in  variance  components  models.  Math. 

Operationsforsche.  Statist,  series  Statistics.  8,  251-255. 

Searle,  S.  R.  (1971).  Linear  Models.  John  Wiley  and  Sons,  New  York. 
Seely,  J.  F.  and  El-Bassioni,  Y.  (1983).  Applying  Wald's  variance 
component  test,  Ann.  Statist.  11,  197-201. 

Seifert,  B.  (1978).  A  note  on  the  UMPU  character  of  a  test  for  the  mean 
in  balanced  randomized  nested  classification.  Statistics,  9,  185-189. 

Seifert,  B.  (1979).  Optimal  testing  for  fixed  effects  in  general  balanced 
mixed  classification  models.  Statistics,  10,  237-256. 

Seifert,  B.  (1981).  Explicit  formulae  of  exact  tests  in  mixed  balanced 

ANOVA  models.  Biom.  J.  23,  535-550. 

Seifert,  B.  (1985).  Estimation  and  test  of  variance  components  using  the 
MINQUE  method.  Statistics  16,  621-635. 


